Video 
data 



Object 
data 



Relevant 
data 



100 



101 



102 



103 



Video playback unit 



Object data 

management 

department 



Relevant data 
playback unit 




106 



108 



Image composition unit] -*- Display unit 



Designation object 
determination unit 



107 



Designation 
input unit 



^7" 

109 



FIG.1 



Start 




Acquire a clicked coordinate 



I 



Acquire list of objects existing in video with 
respect to displayed frame number 



S200 
-S201 



Select unprocessed objects from list [ ^S202 




FIG. 2 




1997 
1999 
2000 
2002 
Family : 
Home page : 
fan club : • 



FW A A 
OO year 
Birth data: XX 

U21 representative 
□□ representative 
Most valuable player 
Maximum score 



FIG. 3 



400 





J— 404 



FIG. 4 




Draw up list of objects existing in video "J^ 



with respect to displayed frame number 



S500 



Delete object having no relevant information 
from list of objects 



j^S501 



Select unp rocessed object from list of objects S502 

T 

Restore object region in displayed frame [^-S503 



Scale object region and display list 
appearance objects on window 



ist 01 | ^S504 




FIG. 6 



T 

604 



Draw up a list of objects existing 
in displayed video 



S600 



Delete object having no relevant 
information from list of objects 



}- 



S601 



Select unprocessed object from list of objects | ^S602 



3 



Restore object region 



Scale only object region and display list of 
appearance objects on window 



J— S603 
--S604 



Is there 
unprocessed object in object 



• S605 



FIG. 7 



Make all pixels of 
mask image 1 




Make all pixels of 
mask image 0 



-S903 



Draw up a list of objects existing in video 
with respect to displayed frame number 



-S904 



Delete object having no relevant information 
from list of objects 



J^S905 



Select unproce ssed object from list of objects k^S906 

„ 



| Restore object region in displayed frame | 






Make pixels in object region in mask image 1 | 








S909 



Display video with 0 pixels of mask image being 
dark, and 1 pixels being normal brightness 



-S902 



I 



FIG. 9 



No 




Display video 




) — S1100 



S1101 



Draw up a list of objects existing in video 
with respect to displayed frame number 



-S1102 



Delete object having no relevant information 
from list of objects 



S1103 



Select unprocessed object from list of objects | ^S1 1 04 

T 



Restore object region in displayed frame ~| ^S1 1 05 



| Acquire explanatory note of object [ 






Compute position and size of balloon \ 




f 


Display balloon on displayed video |- 







) — ^S1106 



Is there 
unprocessed object in object 



No 





FIG. 13 



1400 
Team A 



1401 

r— FW Utida -I 



— MF Maeda 



MF Takeda 



' — GK Ueda 



, ^1402 
Face^ 1403 

CArms^ 
Legs 



FIG. 14 



MF Utida 



MF Maeda 




MF Takeda 



GK Ueda 



,1500 



1501 




FIG. 15 



J 




Draw up a list of objects existing in 
displayed video 



S1600 



Select unprocessed object from list of objects S1601 



Acquire explanatory note of object S1602 



I 



Display explanatory note of object on appearance 
object explanatory note list window 




S1603 



S1604 



FIG. 16 



Start 




Acquire file name of designated 
relevant information 



Specify relevant information specifying 
data including file name 



Determine an object of a display object 
from object information including specified 
relevant data specification data 



S1800 



S1801 



S1802 



Acquire appearance time of day of object from I 
object region data of object to be displayed | 



S1803 



Play back video from appearance time of an object \ ^ S1804 



Play back video 



-S1900 



Acquire position of mouse cursor | -^S1901 



S1903 


No ^ 

r 


Make video p 
into usual plaj 


ayback speed \ 
/back speed 




Make video playback speed 
into slow playback speed 



FIG. 19 



S1902 




—S1904 
S1905 



2000 



2006 




997 
1999 
2000 
2002 
Family : 
Home page : 
fan club : • • 



FWA A 
OOyear 
Birth date: XX 
U21 representative 
□□ representative 
Most valuable player 
Maximum score 



Acquire clicked coordinate 



}^S2100 



Draw up a list of objects existing in video 
in interval from currently displayed frame 
to M frame 



-S2101 



Select unprocessed object from list ~[ -^S2102 



Restore object regions from currently 
displayed frame to M frame sequentially 



-S2103 




FIG. 21 



r 



Video data 





Object region data 


Object 

information 

data 


Relevant information specifying data 


Access control data 


Video specifying data 




Explanatory note data 



Relevant information data 



FIG. 22 



n 



f 



FW Utida 



MF Maeda 



MFTakeda 



GK Ueda 



2300 



\ 




■2301 



F I G. 23 




F I G. 24 




Compute a scaling rate 



S2508 

i_ d 

Display image in display region 
at computed scaling rate 



F I G. 25 



End 



